Open Data Infrastructure // Opendata.ch 2017

# Open Data Infrastructure

---

![](infrastructure/aamsler.png) ![](infrastructure/bskinner.png) ![](infrastructure/jplovato.jpg)

<small>*A warm welcome to all!*</small>

---

#### *[60 seconds](https://www.dropbox.com/sc/p68j1bn8dsw4gnw/AAAYuyDtoy7Hc6UIOQc3OvyVa) of contemplation.*

---

![](infrastructure/CH-000001-5GS-ZBINDEN-A-705.png)

## unconditional,basic,data

<br>
Oleg Lavrovsky

---

> Historical image via [Government of Alberta](http://history.alberta.ca/energyheritage/oil/the-leduc-era-1947-to-1970s/scientific-advances-and-pipeline-technology/petroleum-geology.aspx)

---

<pre style="overflow:hidden">llllllll
................................................................................................................................................................................................................
cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc
jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj
öööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööööö
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
üüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüü
88888888888888888888888888888888888888888</pre>

---

---

---

class: center, middle
<img src="infrastructure/stickman.svg" width="30%">
#### *"There is no spoon!"*

---

---

« <em style="font-style:normal;font-size:135%">Emerging open data infrastructures resemble the myth</em> of the ‘Tower of Babel’: more information is produced, but it is **encoded in different languages and forms**, preventing data publishers and their publics from communicating with one another. What makes data usable under these circumstances? How can we close the information chain loop? <br><em style="font-style:normal;font-size:120%"><u>The short answer: by providing **‘good quality’ open data**</u> </em>»

---

class: center, middle
<a href="https://commons.wikimedia.org/wiki/File:Brueghel-tower-of-babel.jpg?uselang=de"><img src="infrastructure/Brueghel-tower-of-babel.jpg" width="100%"></a>

---

<em style="font-style:normal;font-weight:bold;font-size:255%">‘good quality’</em>

---

> [weisserstier](https://www.flickr.com/photos/alfreddiem/3765562517/) CC BY 2.0

---

> [Jason Scragz](https://www.flickr.com/photos/scragz/152636264/) CC BY 2.0

---

Sources

Pipes

Discovery

Design

Ownership

Accessibility

Usability + Uptime

---

## Sources

<small>Though it can help to orientate well in the data landscape,
the important<br> <u>thing is knowing how much you should [trust](http://www.ppehlab.org/datarefuge) the people upstream</u>.</small>

> FOAG + canton Bern, SFOE via [GeoAdmin](https://map.geo.admin.ch/?lang=en&topic=ech&bgLayer=voidLayer&layers=ch.swisstopo.zeitreihen,ch.bfs.gebaeude_wohnungs_register,ch.bav.haltestellen-oev,ch.swisstopo.swisstlm3d-wanderwege,ch.blw.emapis-wasserversorgung,ch.bfe.kleinwasserkraftpotentiale&layers_visibility=false,false,false,false,true,true&layers_timestamp=18641231,,,,,&X=199562.60&Y=596866.53&zoom=5)

---

---

class: imagefill
background-image: url(infrastructure/opendataswiss-security.png)

---

## Pipes

<small>Peering. Fiber. 4G. Connectivity and [storage](https://hackernoon.com/how-your-data-is-stored-or-the-laws-of-the-imaginary-greeks-54c569c17a49) are basic prerequisites, and<br>
  there will always be users getting by with far less than we expect.<br>
<u>Organise events, build spaces, pool together our resources.</u></small>

> [Martyn Smith](https://www.flickr.com/photos/tinz/16066578923/in/photostream/) CC BY 2.0

---

---

## Discovery

<small>Where is it? What is it for? Are we all even *looking at the same thing?*<br>
Good quality discovery opens the door for others to [follow](https://github.com/Chicago/climatechangeisreal) confidently.<br><u>Mark the trail.</u></small>

- Footnotes
- Portals + search + agents
- Social media + [forums](http://forum.schoolofdata.ch) + [sharing](http://opendataswiss-handbook-preview.datalets.ch/library/embed.html)
- Hackathons + workshops + this conference

---

class: center, middle
[![](infrastructure/handbook_embed_architecture.svg)](https://handbook.opendata.swiss/library/embed.html)

---

---

## Design

<small>Why should someone spend their precious time here? Let us stop bulletproofing our powerpoints, and start letting customers, visitors, people at large, <u>connect with us and our data at a more [intimate](https://en.wikipedia.org/wiki/Thomas_Paine#/media/File:PaineAgeReason.png) level.</u></small>

- Visualisations + laboratory & real-world 'apps'
- Public (trends + [analytics](https://data.montgomerycountymd.gov/analytics) + [metrics](https://data.gov.au/dataset/selected-data-gov-au-web-analytics) + [evaluations](https://index.okfn.org/place/ch/))
- Demonstrated [willingness](http://climatechange.cityofchicago.org/) to experiment

---

[<img src="infrastructure/schlaumeier.png" width="100%">](http://bd.schoolofdata.ch/project/14.html)

---

## Ownership

<small>“No, we want the data raw, and we want the data [now](https://blog.okfn.org/2007/11/07/give-us-the-data-raw-and-give-it-to-us-now/).”
  Build on Fair Use<br> as a <u>foundation for mutual respect</u>, and a thriving ecosystem will follow.</small>

- Tolerance
- Support options + [Right to Repair](https://repair.org/)
- Progressive licensing
- One portal, many mirrors
- One row, many co-authors

---

---

---

## Accessibility

<small>Nobody expects a song-and-dance routine, *though that could be nice on special occasions*, but please <u>let us take a look at your data</u> without climbing up and down a slippery pipe.</small>

- Structural [integrity](http://goodtables.okfnlabs.org/) (+ simplicity)
- [Documentation](http://handbook.opendata.swiss) + examples + examples + examples
- Variety of (code + spoken) languages + shared [tools](https://developer.rackspace.com/blog/deploying-jupyterhub-for-education/) + publications

---

---

## Usability

<small>There is data that has not yet found a (wider) audience. There is [data](https://deepmind.com/research/open-source/open-source-datasets/) whose
  <br>audience we do not quite understand. And then there's unusable data.
<br><u>Which one is yours?</u>
</small>

- [Consistent](http://lindas-data.ch/#/developer/ontology) schema + metadata
- (Data + Code) [Packages](http://food.schoolofdata.ch)
- APIs + bulk downloads + plain text

---

---

## Uptime ...

---

---

---

<small>See also: <a href="https://tahoe-lafs.org/trac/tahoe-lafs">Tahoe-LAFS</a></small>

---

<small>See also: <a href="https://datarefuge.github.io/workflow/">DataRefuge Workflow</a></small>

---

---

class: keypoint, center, middle
background-image: url('infrastructure/2017-05-23 16.16.28 final.jpg')

---

class: keypoint, center, middle
background-image: url('infrastructure/2017-05-23 16.16.28.jpg')

---

class: keypoint, center, middle
background-image: url('infrastructure/2017-05-23 16.16.28.jpg')

<u style="display:block;padding:1em;margin:2em;font-size:90%"><a rel="license" href="http://creativecommons.org/licenses/by/4.0/"><img alt="Creative Commons Licence" style="border-width:0" src="https://i.creativecommons.org/l/by/4.0/88x31.png" /></a>
This presentation by Oleg Lavrovsky is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br><br> Your feedback will be most welcomed via [datalets.ch](http://datalets.ch) and otherwise.</u>